Papers with code implementation
CoAnnotating: Uncertainty-Guided Work Allocation between Human and Large Language Models for Data Annotation (2023.emnlp-main)
Copied to clipboard
| Challenge: | Annotated data plays a critical role in training models and evaluating their performance. |
| Approach: | They propose a paradigm for Human-LLM co-annotation of unstructured texts at scale that utilizes uncertainty to estimate LLMs’ annotation capability. |
| Outcome: | The proposed model outperforms existing models on many text-annotation tasks with up to 21% performance improvement over random baseline. |
Hardware-Aware Parallel Prompt Decoding for Memory-Efficient Acceleration of LLM Inference (2025.findings-emnlp)
Copied to clipboard
Hao Mark Chen, Wayne Luk, Yiu Ka Fai Cedric, Rui Li, Konstantin Mishchenko, Stylianos Venieris, Hongxiang Fan
| Challenge: | Auto-regressive decoding of Large Language Models results in significant overheads in hardware performance . a novel parallel prompt decoding approach is proposed to overcome these limitations . |
| Approach: | They propose a parallel prompt decoding that uses a single model for speculation and verification. |
| Outcome: | The proposed approach speeds up auto-regressive decoding of large language models 2.49 times . it can be used on mobileLlama to Vicuna-13B on a wide range of benchmarks . |
How Transliterations Improve Crosslingual Alignment (2025.coling-main)
Copied to clipboard
Yihong Liu, Mingyang Wang, Amir Hossein Kargaran, Ayyoob ImaniGooghari, Orgest Xhelili, Haotian Ye, Chunlan Ma, François Yvon, Hinrich Schütze
| Challenge: | Recent studies show that post-aligning multilingual pretrained language models improve crosslingual alignment, but it is unclear how and why this is achieved. |
| Approach: | They propose to explicitly evaluate crosslingual alignment by adding transliterations to models using original and transliterated data. |
| Outcome: | The proposed approach improves crosslingual alignment even for random sentences. |
TURTLEAI: Benchmarking Multimodal Models for Visual Programming in Turtle Graphics (2026.findings-acl)
Copied to clipboard
| Challenge: | Vision-language models have been explored for visual programming, but performance is unclear . most prior work focuses on visual programming for productivity . |
| Approach: | They propose a visual programming benchmark that uses visual programming to evaluate VLMs. |
| Outcome: | The proposed model improves on GPT-5, GPT-4o, and Qwen2-VL-72B on real-world tasks by 20% . the proposed model is based on 823 visual programming tasks in the Turtle Graphics domain . |
Interconnected Question Generation with Coreference Alignment and Conversation Flow Modeling (P19-1)
Copied to clipboard
| Challenge: | Extensive experiments show that our system outperforms several baselines and can generate highly conversational questions. |
| Approach: | They propose a neural model that generates interconnected questions in question-answering style conversations. |
| Outcome: | The proposed model outperforms baselines and can generate highly conversational questions. |
FESTA: Functionally Equivalent Sampling for Trust Assessment of Multimodal LLMs (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for trust assessment of multimodal large language models generate mispredictions due to multimodal input paradigms. |
| Approach: | They propose a multimodal input sampling technique that generates an uncertainty measure based on equivalent and complementary input samplings. |
| Outcome: | The proposed technique improves selective prediction performance with visual and audio reasoning tasks. |
CodeAgent: Enhancing Code Generation with Tool-Integrated Agent Systems for Real-World Repo-level Coding Challenges (2024.acl-long)
Copied to clipboard
| Challenge: | Large Language Models excel in simple tasks such as generating standalone code units, but real-world software development often involves complex code repositories with complex dependencies and extensive documentation. |
| Approach: | They propose a novel LLM-based agent framework that employs external tools for effective repo-level code generation. |
| Outcome: | The proposed framework outperforms commercial products like Github Copilot in the humanEval benchmark and shows that it is adaptable and efficient across multiple code generation tasks. |
Large Language Models Are Reasoning Teachers (2023.acl-long)
Copied to clipboard
| Challenge: | Recent studies have shown that chain-of-thought (CoT) prompting can elicit language models to solve complex reasoning tasks step-by-step. |
| Approach: | They propose a method that uses large model samples as reasoning teachers to fine-tune smaller models. |
| Outcome: | The proposed method outperforms prompt-based methods and the teacher model in many tasks and extends it by leveraging the teacher's ability to generate multiple rationales for each original sample. |